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ABSTRACT 



currently, findings of educational research are of 
little consequence to\ the curricular/instructional decisions of 
social studies teachers.. Pour basic conditions have created this 
inconsistency. (1) Since sooial studies teaching takes place among 
value and factual assumptions, decisions about educational practice 
are \based more on Value judgments than on research data/or theory. 
(2) Uenerally; : there is 4 lacJc of consistent, cumulative, i^efinitive 
rei^elrc^ findXngs, on which to make curricular/instructional 
p resell piiohs. Host resear-ch is carried oiit by doctoral candidates 
and supervised by professors, ^ma^ny of whom lack^ commitment to 

\research. Moreover, results' that are merely statistically 
signif icantgt although trivial in nature, contribute to the. fragmented 
nature- of social studies research. Research findings ^re sterile 
b€icause they are abstractions,^ out of touch with reality.^ (3) The 

. concerns of social studies teachers tend to kye different from those 
of university professors who' conduct and supervise most research. (4) 
The .instruction/learning model that . has dominated the design of 
so.cial studies is>t>verly simple. Therefore, social studies^ 
researchers need to reconsider^ the nature of their enterprise. , 
Attent^n must be focused on those attributes of science which are 
applicable to educational research, including the role of theoty in 
educational praptice, th^ functionality qf r^earch strategies, and 
realistic "goals. (KC) ' 
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ARE Ei)UCATIONAL RESEARCH FINDINGS USEFUL FOR 
CURRICULAR/INSTRUCiTIONAL DECISIONS?^ A SKEPTICAL VIEW* 

■ • , , ^ 

James P. Shaver 
Utah State University" 

A common goal — perhaps one could\say, dream — among 1 educational) re- 
searchers is to Impact practice In the schools. The hope Is that thelt; 
research will ^help practitioners Improve th^ educational experiences of 
children and yoiith. Some anticipate doing a lan^Jjtark study that will" 
revolutionize' BchWi^j^*.._More f the expecFatiOn-^s that Jthe_ . 

Studies they do will contribute to an accumulation of knowledge from 
which schooling decisions can be made. For some, this means trying ^to 
build and verify theory that could be applied In making' currlcular/ln- , 
structional decisions. 2 The major focus of this' paper is whether that 
goal, or dream,* has been realized in social studies education — or is 
likely to be in the near future. As the title indicates, my conclusion. , 
is not overwhelmingly positive. ^ ^ 

^ i The Teacher as Focal Point , / 

In such a paper, bne could focus on any of a number of decision points 



*PaT>er presented^ at the annual meeting of the National Council for tjie 
*Sox:lal Studies,. Houston, November 24, 1978, as recipient of the NCSS Citation 
for* Exemplary Research in Social Studies Education, 1977. 

^ ^"Curricular" decisions are taken iti thiy paper to refer^ to decisions 
about appropriate teaching goals and the ! experiences to reach them. "In- ^ 
structionpl" decisions are taken to be those about how to teaoh within some 
implicit or explicit curricular frame. ; ' , 

2p;j^naj- (1978) categorized curriculum researchers into three, groups: 
traditionalists" who are basically atheoretical and concerned with produc- ^ 
iRg tesfearch findings oi direct help to pract itionerfl|a '^conceptual-empiricist 
who believe that improvement of practice will come thl^ough the application 
of theory that has been empirically verified; and, "rdconceptualila^d" who 
are basically theory-oriented, with the hope that fueuriBiCyiceptuallzations 
will provide more fruitful perspectives for approacbln^ schooling and re- 
search* abgut it. I presume that most social studies education researchers 
fall explicitly in the first category^ that a few would like to be in the ^ 
'Second category, and- that ve?y few are in the third category. 
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about curriculum and instruction — thqi curriculum developer > the methods 
course professor, the social studies supervisor, and/or the teacher. Of 
1 all of these, howeve/, it is the teacher who is the key tp what happens 

/ to students In social studies*^ The teacher not only interacts with the 
students each day, but in our system of education, tends to be the arbiter 
of what happens in his or her^lassroom. The notion of the teacher as 
V the central figure in a classroom domain that is not to be intruded upon 
^ lightly by others has not beipn broken down by attempted innovations such 
as team teaching. Although teachers do lack control of the budget, and 

« .f" ■ ~: ' ■ 

SO find it' dlff i^lt' toomak'e curricular or instruct ional changes that cost 
money, they do exert grea^ power as members of textbook selection commit- ^ 
' " tees and,- even more Importantly; in determining what will happen to the 

students in theirs classes. 

Teachets c^n thwart, *^nd have thwarted, the best intentions of social 
stiMles currlculiipi reformers. A recent example of reform languishing at 
the clas&room door*.is the "New* Social Studies" movement of the 1960*8 
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(Shaver, Davis & Helburn, 1978; Weiss, 1978; Wiley; 1977, Sec. 4). As 
a matter of fact, it appears that teachers tend to rely on other teachers 
for teaching advice, not on university specialists or district supervisors 
(Stake & Easley-, 1978, especiallj^ Chs. I> an<J 19). Teachers are probably 
little aware of the findings of educational research (e.g., Wiley, i977, 
p! 9), and the theme of this paper Is ttnaf it would probably be of little 
coilsequence to their curricular/instructlonal decision-making if they were. 
A discussion of the reasons for that conclusion follows. 



%or discussion and verification of "The teacher as key", see Stake 
and Easley (1978), especially Chapter 19. 



r 
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Resea»ch and the Prescription of Practice 
One of the functions of the "Intelllgensla" of social studies educa- 
tlon— the "Intellectual leadership"** Is" to make ptonouncements about cur- 
.rlcular/lnstructlonal poltcy, li^ the sense of prescribing. appropriate 
courses of action for schools 'and teachers. Of course. Individual teach- 
ers formulate that type of policy themselverf' as well, although In much 
less self-conscious e(nd public ways. The "leaders" often try to rely on 
research findings and theoretical fqpiulatlons In their position state- 
ments, while educational research findings and education-related theory 
peem to be largely Ignored by^'teacher s . Are the "leaders" justified In 
their attempts at reliance, and should teachers be made more sharply a*- 
ware of th? relevance of research findings and education-related theory 
to their own curr Icular/lnstructlonal decision-making? Such a question 
must be answered In terms of (a(), the Intrinsic role of empirical data and 
formulations In policy making and (b) the adequacy of the available em- 
plrlcal knowledge base for currlcular /instructional decision-making. 



Facts, T'heory, and Policy ' 

* r 

A finding, set of filings, of empirically based t!heory may indi- 

cate quite different poJ^ig^ positions to rational decision-makers, re*- 

lying on different empirijcal knowledge or assumptions and values. In 

social policy studies, the principle that empirical data or theory do 

not necessarily prescribe policy seems to be well established. Because 

■ 

•wecanbull^ a neutron bomb does not mean that we>hould necessarily pro- 



\ 



I put intellectual leadership in quotes because there Is serious 
doubt how many followers there are, as I have suggested in .the previous 
section. The snmll proportion of social studies teachers who are mem- 
bers of th^ National Council for the Social Studies is an illustration 
of the point.---^ 

• ' ■ • 5 



ceed to) do so. There are serio^S^value questions and other empirTCal 
|l( ^ quea^tClona to be weighed first. That principle seems to* be less well 

accepted among social studies "leaders", who frequently seem still to 
be caught uf> in the American spirit that "if it can be done, it should 
be done". The current enthu84.^jpi of some socTal studies educators for 
I getting teachers to use instructional techniques designed to enhance 

development through th^ moral stages that Kohlberg has theorized would 
be \a good example — if there were not such serious questions about the 

1 

philosophical (e.g., Peters, 1965) and empirical bases (e.g., Fraenkel, 
1976, 1977; Lockwood, 1978; Shaver, 1977) for Kohlberg 's theory and the 
in3tructional recommendations. ^ 

4 

The phenomenon of wanting tt) do what can be: done as rapidly as possible 
has also been evident in attempts to apply Piaget's work to the making of 
Education prescriptions. "If" there are developmental cognitive stages," 
t the American says, "then shouldn't we develop curricula and instructional 

techniques to move children through the stages a^\rapidly as possible?" 

> / 



It is easy for tbe proponents of such movements and the critics, such 
as myself , to overestimate the classroom activity generated by bandwagons 
.such as Kohlbergian moral development, Raths-'Simon Value clarification, or, 
the discipline-centered teaching of the "New Social Studies". A couple of 
ijietaphors come Co mind. One is social studies as an iceberg, with .the tip — ^ 
i.e., the activity — showing above thte surface of the ocean, bdt with the \ 
mass of .the iceberg— that is, the great major.ity of American schools and 
social studies teachers g^ing on as bef ore^-largely unobservable and/or^ . 
unobserved. The other ^metaphor is of social studies education as a deep ^ 
lake with the wind rippling the surface. The innovations do ripple the 
observable' surface of social studies edticatlon, ,but the gifeat body of 
schooling below the surface remain^ largely undisturbed. The Case Studies > 
in Science Education (Stake & Easley, 1978) and the NSF-sponsored National 
Survey of Science, Mathematics, and Social Studies Educa^tion XWeiss, 1978) 
proyide confirming* evidence for this vi^w^ of surface change. The metaphors 
and the CSSE report also rais^ the question. Why are there so few deep, s^a 
and scuba divers — to extend the metaphors — in social studies education (or 
educat:lonal) research? 
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Plaget himself hjas referred tos^he American queistlon" — "Is It pot^slble to 
speed up the learning of conservation concepts?"* (Hall, 1970, p. 30). His 
response is directly pertinent to tl^e point bf thl# piper. There is, he '^ 
indicated^ a counter-question-'^to be asked — ''Is it a goo^ thing to accel^ate 
the learning, of these concepts?" And, tKere are good reasons .foi^ a \|fesitant 
r'eponse, (Hali, 1970): .-^ , 



Acceleration is certainly possible but first we must find 
out whether It is desirable or harmful. . . . Perhaps a cer- 
tain slownesa is useful in developing the capacity t^ assimi- 
late new concepts. ... * • - ' 

[fijlindly to ^accelerate the learnii\g of conservation conae^^ts 
could evenv be worse than doing nothing. ... , 



It is d^f f fcu3l.t to decide just how to shorten studies. If you, 
spend one ydai^ studying something verbally that requires two 
years of derive study, then you have actually lost a year.- If 
we were wiiMng to lose a bit more time and let the childrenX 
^] be active, let them use trial and error on different things, ) 

then the time we seem to have lost we may have actually gainWd. 
(p. 31.) ^ 

Note that Plaget 's own hint at a prescription in the last paragraph i4 temper- 

r 

ed by considering possible gains and losses against an unclerlying value. 

Social studies teaching takes place within a complex of value and fact- 
ual assumptions that make hazardous the prescription of practice based on re- 



search and/or current theory. A paper by 'Judith Torney (1978), which pro- 
vided the original stimulation for this ES<per, can be used to illustrate the 

point further. Tommy's paper is an example of the rather careful use of , - 

1 .\ " " \ 

researcfi findings to develop a case for an educational prescription. But 
it also reflects the difficulties to which I have been alluding* 

Irt her paper, "The Elementary School Years as an Optimal Period for 4 
Learning about International Human Rights", Torney makes several points. Cit-/ ^ 
ing an international study, she claims that a "deficit" exists among American 
fourteen-year-olds — that is, that they are more knowledgeable about domestic 

- \ ■ f ' . 
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political institutions dnd- process thrfn youth in some other countries,. 
^;but less knowledgeable about a"hd Interested in internnt ionA; palitical 
institutions and processes (Torney , 1978 , pp. 3-4). First of all, she 
discusses overcoming this ''deficit" through^»gTiooling. but "koes^not 
examine such factual questions as, Mlcht^lncr easing -international it^ter- 
est and knowledge result in a decrease jln domestic intere&t and know- 
ledge? or such relevant value Judgment questions as. Would such a re- 
dress of balance be desirable? ^ * 

Later Ifi the paper, after fresentlng-evldence that there Is con- 

- ■ . • A • 

siderable international consensus about human* rights, ItTorney turns to 
'^he'matter of theVelementary school as an optimal^ period of education 
abou6 those rights^ V She discusses (p. 11) the notion of -a "critical ot 

' / ' A^ ^- ' ' ' ' ' > - 

optimal period*' duting which' >the "high degree of plasticity'^ in afi or- 
^ ginism makes the reorganisation of behavior patterns relatively easy, 
and suggests that the felementary school may be thought of as an optimal 
time to teach about human rights, Alth*ough Torney does note the dif- - 
ficulty of testing such a notion empirically (p. 11), she goes on to 
cite "some research evidence which shows, particular peaks of attitjbdes or 

abilities during the elementary school period" and "provide[s] useful 

^. ^ 

information about the psycholiagical characterises of children" (p. 11).'^' 

^ " \ ' ^ ^ ' ' ^ / * 

"The research evidence has to do with the apparently- rapid cognitive- 



social development of elementary school children and an ^pp^rent "loss ' 

si • * 

of ,attltudinal plasticity" at about age twelve to fourteen. Torney rec- ' 

r * 

^ . • • ■ ■ ' ' \ 




d 

"dlcated that her meaning was the same 



ognizes that different studies have found the x^rowth and Iomh of ntast lctt 

to take place at somewhat different ages. Never thelcKS, ^he conducted: 

■'<•. / * ' .1 ^\ ■ , ' 

The concluslbn one may draw from research, eyohw-ith differences 
' In method and in the year \n which change appearrf to^ be raofi^t 
rapid, is that, thd elemteixtary scHool period is Qptjimal for A 
.,jpd6catlon abadt Other nations, global^ Issues , ancTj Intprnat lonal 
"rights. (p.yS) \ , ■ ' / ^ ^ 

Her conclusion Is questionable, jegjirdless of the validity of the ^ 



underlying studies. li\ the ^l^st • place, it ignores alternate explanajilo^ 
of .the findings she 6ites, such a-^ the potientlal institutional efi 



)iana|iion 
'feqtsV \ 

on youth. Assuming that 'there la loss openness and plasticity In re^ 



gard to^ other people^ <ind countries, is It a function of n.or«ial develop- 
ment or of tfie impact of schoolin'g? ffould it b6 the resulo of a change 
from person-centerea instruction ^t the elementar^school j|o ^predominant- 
ly content-oriented Instruction in secondary school"? Mor/over,;a prb- 
posal -to .attempt to accelerate inteVnatlortal socialVonsciousness ^at th6 
el^entary age level iriust be met with Piaget ' s jcpunter-question: "Is 
it desirable or harm^ul^" Would it, for example, interfere with the nat- 
ural process of. growElT^y not_ allowing adequate time for assimilatioln of 
tlifi oncept* of culture and of varying cultural piefspectives? 

To further illustrate the, difficulty of prescribing educational ^ 
practice from research findings, Piaget!s own theory provides a counter- 
ar^jojnent to Xorney's proposal. That is," to fully understand other coun- 
tries and th^ concepts of , International la^w and polixj-cs, as well as< to 
empathize witl^ people with whom one cannot have direct contact, onaV well 
presume, the abstract thinking abilities of Piaget's Formal Operations 
Period. This line of reasoning suggests" that the years beyond age 11 or 
12 might be the optimal time for teaching about inteiuiational rights, ^ind 
that our attention should be dire^ed (accepting tTie value judgment that 



the goals Torney proposea are acceptablt; for American Hchools) toward ro~ 

» 

structuring our achoolH, curricula, and Inatructlon at that level. in 
short, appropriate changes In education in international human rights may 
really be needed following elementary school to capitalize on potential 
cognitive develo^'itfent . Until we know more about cognitive growtlj and 
attitudinal plasticity and about the causes — e.g. , developmental versus 
Inst Itut ional--of both, the prescription ol^ practice in that area using 
a research base seems at be^t a dubious proposition. 

In genera^> then, the prescription of educational practice from^re- 
search findings' must be approached with caution. Given the present state 
of educational research knowledge, the prescriptive implications of any 
set of findings will rarely, if ever, be unequivocal. And, because pre- 
script ions are based on value judgments, the examination of competing 
values must always Intercede between data or theory and prescription. 

V 

The/State of. Research Knowledge ^ 

"^7 ■■ ■ ■ 

• ThV second major consideration in any attempt to prescribe education- 

A ■ ^ 

al practice from research findings is the adequacy of the available re- 

se^ch l^owledge base. Gage (1978) notes that 'tpost reviewers of research 

on tea(^hing have concluded their reports by saying that past work has been 

essentially fruitless" (p. 1). Most reviews in the area of social studies 

education tftsearch have Qome to similAr conclusions, as Karen Wiley's (1977) 

recent "review of prior reviews'' indicates. Some of Wiley's observations 

and conclusions Include: 

^ Many reviewers have expressed concern over the lack of a 
cumulative research base in social studies/social science 
education, (p. 165) 

[ijittle or no research has focused on questions about the 
relative merits ^i£-.dirfferent kinds of content (e.g., social 
science, public issues, -chronologieal history) in achieving 
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the\gouI« of Huclal Htudlea. (p, 169) 



Thta area of Hoclal stud Icb/hoc ial nclonce education reacarch 
.[cf^cctlvcaesB andlef f Iclcncy of Indtruct lonal mcthoda and 
technlque^J appeals to be fairly chaotic, at least from the 
perapective of extant revlewH, both comprehensive and special 
focus. Although a large portion of research falls under this 
heading^ this research appears to have yielded few conclusions 
that oofe can endorse with much cot^fidence and few guidelines 
for practitioners^ (p. 171) 

Ther^ has apparently been little rese^roft on the effectiveness * 
of various types of curriculum material^. . - although there 
has been much research analyzing itfaterials. • . and sdpie re- 
search on tt\e extent of use of various kinds of raaterfals. (p. 197) 

Wilej^ doe^ not paint an entJ^rely bleak picture (e.g., shte draws ' 

positive conclusions in the areas of teaching for c^p^ical thinking''' (PP» 

174-7) and ^^models for factual and concept teaching", (p. 192^), but the ' 

overall >^e88age is clear: Tliere is generally a lack of consistent, cum-- 

ulative, def^initive research findings upon which to make currlcular Ain- 

"r >■ 

struction^l prescriptions |in social studies ^<^lication; or conversely, 
teachers arp losing little in decision-making power by their inattention 
to the re^t^arch 1 1 tera ture>... ^ ' 

Wiley (k>77,^ 156-7, 177) does suggest that there may be more of a 
cumulative research ba^e in existence^ than, is evident, because reviewers 
have not adequ^ely organised and interpreted "the disparate bits and 
pieces of research" available. She suggests that meaning and order might 
be teased out of this ''numerous small, uncoordinated studies" by concentrat- 
ing on limited toplcso^d on research in and out of social studies conduct- 

! 

• ed over a numbel: of years. ^ 

Gage^ (1978) also maintains that the state ofj educational research know^ 

^However, she refers j^o the "few scattered findings, which are tenta- 
tive suggestions at best* l^^z ."(' p. *176). 

8 

Martorella (1977), to whom Wiley, refers, indicates that "there are 
sljill mor'e questions than auawers" about the "instruct ipnal variables that 
O have a significant, effect upon cognitive outcomes" (p. 45). i 

It 
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IcdRo In probably not hh illnmrtl nn rfvVlcwtMM Iwivo liu^hati^l. Ht* liilln \l or 
more valid r^^vtewH. payliiK attiMUltMi to HtatlHtic/il roHiiltH /iiul more* 

lit tent lun to coff8lHtcMU!y In MndlngH. He aUo rorommt'iulH thr uhv of poHt 
hoc Htiitlstlcal techniques, nuch aH developed by Karl and Kgon Pearnon 

* (Jonefl 6i Flske. 19,63) and f;iaHH (1976).. for amnHHlng reHuUw acroH8 pre- 
vlously conducted Studies. I would not be aH har«h In my Judgment of Ruch 

) Bta^^atlcal endeavors as Kyaenck (1,978), who objected to attempts to use 



Glaser's meta-aocilysla to "diHtlll scientific knowledge from a compilation 
of studies mostly of poor design" with the comments: ''Garbage in — ^j^rbage 
out" Is^ well-know axiom of computer speciallBts; It applies hereA^lth 
equal for^e!*. But I am not optimistic about the likely l^enefits of grand 
statistical analyaes as a. post hoc substitute fora priori attention to re- 
search strategy and design. I also am dubious that, as Wiley suggests, 

scattered, but relatable and valid findings are in the literature waiting 

i , 

to be given mining. ^ ' . 



Appropriate F!>gsearch Models ? ^ 

Concern with the -lack of a research base f^r prescribing practice in 
social studies education raises the question as to why so much of the re- 
search activity in this^ field has been unfertile. I have explored else- 
where (Shaver, in press) some reasons for the lack of productivity of ed- 
ducat ional research, and the argui^ents presented there in regard to educa- 
tional research in gQnea;;a^l apply tp research in social studies education. 
Part of the problem is thaft the bulk of the research is carried out^by 
doctoral candidates (Wiley, 1977, pp. ^155-6) who frequently see *their-*re- 
search only as a hurdle on the way to a degree, and who are supervised by 
professors who also lack both commitment to research and understanding of 
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research procedures The consequences are that much worthless Research 
is "donev and nev gener-ations of university professors are socialised in . 
attitudes dysfunctional to the building of*' cumulative knowledge. Basic 
\to this problem are, the superficial consideration and understanding of 

' ' I- ' ' - ' 

* science' among educational researchers and an attendant uncritical emphasis 

on the *'test of statistical significance" approach to research as ex- 

^ 10 ' 

emplifying science. . 



, -- The Test of Significance Approach . One outcome of the fest of signifi- 
cance ^approach educational research has been thfe celebration of the 
trivial result. Too many graduate students are socialized ("educated" 
certainly seems the wrong word) to believe that if a result reaches the 
mystical ^<05 lev^l of signif |.e^ance it is important. Too rarely are they 
asked or helped to defend that level of significance, or any other, on 
grDunds such as the potential .costs and consequences of the decision to 
be made based on the results. A related but even more serious deficiency 
is that they are^not encouraged to think in terms of . the educational sig- 
nificance of th^ir findings. Significant Pearson prodifct-moment correla- 
tion coefficients are reported without computation of r-^ (the coefficient 
of determination) which indicates the percentage of variance the two 

variables have in common, or. put • another way^ the percentage of variance 

,- ■ , > ' 

in one variajsle accounted for by the var^nce* in the other. Statistically 

: * " ' ' . - 



9 • • 
I avoid coi^jicnt on the uselessness of most of the survey research 

which is carried out by so ii>any doctoral candidates (see Wiley, 1977, p. 166) 

10 ^ ' > - 

A. Guy,,Larkins has noted to me iA ^conversation that there is a corol- 
lary la^k of understanding'' of theory ^nd its role., in scientific knowledge- 
building that contributes to the* dys^unctionality . of educational research. 
I agree. But t am uncertain atJput* th^ extent to which such accord leads 
to a common pqfsition on the nature afr functional theory for schooling. , 
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non-chance relationships th^t are really trivial educationally ^ ( an r 



.195* is significant at the^^S ISjJ^^ith a two-tailed test ^nd 100 degrees 

of freedom; r^^ « •038—3.8% common variance) are greeted with glee. Even 

less frequently is the correlation r^tio (n^) computed following an analy- 
' i ' ■ ' 

r . ..* * . ' 

sis of variance to estimate the proportion of the variance on the dependent 
variable accounted for by the^ independent variable. ' ' 

An example- came to my eye in the last Issue of Theory and Research ^in 

^ Social Education , A study having to do with the "Effects of Coordinated 
Environmental Studies in Social Studies and Science on Student Attitudes 

-toward Growth and Pollution" (Hepburn, Shrum, & Simpson, 1978) found no. 
sl^jtij ^ican t main effect (the independent variable was study of a social 
studies module, a science module, both modules, or no module) for Pollu- 
tion test items, but a statis'^ically significant (P < .01) one for Growth 
^test items for both ninth and tenth ^r ad iers. Fortunately,, the authors pro- 
vided the sums of squares for their analyses of covariance so the comld 
be computed'^^ = main effect sum of squres v total sum of nquare). Eor 
the ninth grade, .0723 and^ for the tenth grade, .0596- (Interestingly, 

r|2 for the cov^iate,' the pretest, was .3776 for the nint^ grade .and .4859 
for the tenth grade.) Now the qu'estion can be raised whether a treatment 
that accounts for only 6 to 7% of the variation on the dependent variable 
iS: educationally significant, and whetl^er the mixed results-*--^ and the cor- 
relation ratios justify *the following claim:, 

Results of this study support the notion that environmental 
fcnowled^^ does influence environmental attitudes. Specifically 
these results indicate that Interdisciplinary instruction which 
^ is coordinated across social studies and. scieijce and which is ' 
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In addition to the lack of signif icarice on Jthe Pollution test items, 
the scletice-only and social studi^s-and-science groups were , signif icantly dif- 
ferent from the control group but not the social studies-only group on Growth 
items atl the ninth grade; and they were.sigoiflcaatly different from the 
ji-^" social studies-only, but hot froW the control group at the tenth grade. ' 



o mainpLy cognitl;^ in approach, can promote positive attitude 
change. . . . Th^'s suggests that environinenta;t education 
should^ be part both the. science ajid social studies curricula 
of high school^,, (p. 8A. Italics mine. " * 

I cannot help but recoil from the rather glib leap from what appear to be 
, trivial, if statistically significant, findings to a curricula^: prescrip- 
tion. . , 

The joy that comes fron^ trivial burj^statistically significant results 
is 'often an aspect, too, of another misunderstanding of scientifl^c know- 
ledge-building— that is, that only statistipafly. significant findings ^re 
worthwhile: So graduate' students worry- not about how their studies tie in 
to past res'^arch, but about whether their results will be significant and 
thus acceptable to their supervisory committees. The notion of testing al 
ternative liypotheses vith crucial -experiments and the accompanying import- 
anc^of disproof tojthe building of knowledge (e.g., Piatt, 1964) seem 
almost entirely foreign to educational research. 

Fundamentally, this misunderstanding of the test of significance ^ 
approach' as .science cqntributes to the fragmented nature of social studies 
research that iis so often lamented (e.g., Wiley,. 1977, 155-6), as does the 

poorly understood application of statlstical^nalyses ;to "prove" the 

" ■ ■ ■ ' , , ■ 

^en^r^^izabillty of. results. The mathematical model!^| underlying the statt- 

Istlcal tests of significnace used to establish gei^rallzability require 

randbm samj^ling from target populatlonsr-a conditio^i^hat'' can rarely be • ' 

met in educational research. Cfiimputing tests, of significance without meet- 

\ ^ f2 ~ ^ i 

^ ' The potential triviallti^ depends on such matters as the validity or 

the tests, the unclear results, and whether the small percentages of vari— 
a^ce^accounted for are worthwhile, especially when weighed against the cost 
of implementing the study, e.g. , financially and In terras of lost opportun- 
ities for other studies in the curriculum. 
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Ing that assumption gives a'^alse, sense of secutrlty in one's results, "^lofe- 

^ • : . ■ • ■ ■ ' . , , 

. over, it hias led educational Researchers away from the essential -scientific . 

strategy for establishing the reliability and generalizablllty of findings— 
, the replication of studies, either directlyjor with systematic varlations^l3 

^ - 1 - ■ . ■ 

' ' ' \ ■ 'I 

Getting at Realities , The positivlst,! statistical inference approach 
S'> . ] . .. 

• , , ' . w ' . » ^ ^ 

to research has led us astray in other ways as well. Such thrusts as the 

^ concern with hypothesis testing, the operatiojial definition of variables and 

the^ assessment in forms appropriate for statistical analysis, the emphasis 

on formal* research des^igns to keep the researcher from contaminating his 

subjects and vice versa, have led ^o research findings 'that are' ffequei^tly 

sterile because they are abstractions, out of toucli with reality. A few 

years ago, Larkins and I argued that a broader conception of a^ropriatiE 

educational research methods^^was needed and suggested that the participant- 

observer , ethnographic approach offered a promising alternative (Shaver & 

Larkins, 1973, .pp. 1254-8). Others, such as Cronbach and Snow (1977, pp. 

16-17, 390, 518) and Wilson (1977) have -advocated similar approaches sifice 

that time. It has only been recently that a maj^r ethnographic study in ' 

social studies education has been reported. . 

' . ■ In 1976, the Education Directorate of the National Science Foundation'- 

contracted for three studies of status antj needs in science, mathematics, and 

social studies education. One of the studies was a rather traditional, i^^ 

well exectited, national survey of teachers and schobl administrators (WeiSs, 

1978). Another was three twenty-year reviews of the research literature, one 

of which (Wiley, 1977) has been cited several times in this paper. The third. 

was Case Studies in'Science Education (CSSE),' an ethnographic .field study condutt- 

jfid at eleven sites across* the nation (Stake & Easley, 1978; Stake, Easleyiet al., 
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A more extended discussion of these" points can be found- in Shaver (in 
press). Also, see Cronbach and Snow (1977,' pp- 16, 22-3, 51-530, 519). . 



1978) • That report — both the individual ca^e studies an^ the aynthesls 
chapters — indicatjes^the rich, strong perspective on the realities of school- ' 
Ing and the facfors that ^condition teaching and educational change that' 
can come from such naturalistic sttidles (see Shaver, Davis & Helbufn, 1978, . 
V for further comments). 

As a matter of fact, the CSSE reppxt Indicates a major reason why the 
findings from most social studies education research would not have much ^ 
relevance for. the decision-making df social studies ^teachers, even it there, 
were more vfilid, non-trivial, cumulative findings. It is that the concerns 
of social Studies teachers tend to be much different., frdm those of the 
university professors who conduct and supervise most research in social 



stud ies^ducat ion. Faced with the day-to-day demands of teaching in a school- 
ing social system which values the^ use of subject matter content for social- 

V'- ■ 

ization — both to meet the demands of the school and for citizenship — teach- 
ers by and lar^fe^ are not much concerned with the questions about inquiry ^ 
teaching, the promotion or critical thinking, the analysis of textbooks, and 
so on that intrigue university professors* In fact, many of the curricular/ 
lnstru£tional ideas advocated and investigated by university professors ' 
threate^ the basic classroom n^anagement fec'hniques of teachers,!^ run 
counter to their reliance on the textbook as the authoritative source of 
knowledge and the central instructional tool, fly In the face of beliefs about 
the need to provide external motivation for children and to socialize them 
for later success in scHool, and are in opposition to a commitment , of ten 
u^X^icated, to the teaching underst^dings from history and government, 
not as ends in ^themselves , but as a means of promoting a positive image of 
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For a summary of research that speaks to teachers classroom needs, 
see Gage (1978, p. 234). 



oUi: nation that is deemed to be an importfant basis for citizenship, y (See 

fftake & Easley, 1978,* especially .Ch. 12/ 13, 16, 17; Shaver/oavis & Helburn 

' . ' \ ' 

1978.) The, Utopian views of democratic political participation tha't dominate 

considerations of social studies education t)y the "Xeaderfe" do not appear to 



provide an adequate basis ^or research that can impact the majority of social 



[studies classrooms. 

Until sociaf studies e/ducation researcher^ become more attune^ to the 

7 y - . , 

realities of the classroom/, and to teachers' perceptions of these realities, • 

■ * ( • 

their, research is not likely to be of much use for prescribing practice 

( r 

there. OSSE suggests how case studies can be used fruitfully to get at that 
reality and those perceptions. It alscr suggests areas of, study for those In 
social studies, education. As a basis for identifying #meaningful research 
problems, more attention is needed, for pxample, to the socialization role of 
the school as the society's formal educational institution^^ and to the 
question of reasonable instructional Remands on teachers in a setting of 
public, universal education. ■'■^ And research 4irected at the factors that in- 
fluence the experiences that social stiidies teachers provide their students — 
Including the conservative effect's of the models of non-inquiry provided by 
theljr own* pre-college and college social science and history teachers, and 
the influrtces exerted on teachers by their school-community social system^ — 
Is among that suggested by the more earthy ethnographic approach of CSSE. 

Along with the indication that educational researchers have often not ' 



"'"^See Berlak ^J|77f % - ' 
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More frequent involvement of teachers as research partners, rather than 
as the subjects^ of research, is desirable if researchers are to Identify 
research problems with greater relevance for teachers (Shaver, Davis, Helbu^:n, 
1978; Gajewsky, 1978). , 
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addressed questions of Interest to teachers is the Implication from the CSSE 

ethnographic- findings that researchers have erxed One other way ijt their* 

orientations. Educational researchers have failed to- recognize that from a 

non-reform^ "needs and demands of society" perspective much may be going 

'on in social studies education that deserves praise. Jacl^Bon arid Kieslar 

(1977) have argued that the orientation of educational researchers has been " 

too narrow because of 

the almost total absorption with the goal of improving practice 
and discovering better techniques. We seldom ask whether educators 
might now be doing as well, as can be done in many aspects of 
their endeavor. We might pay more attention to the possibility 
that educators may deserve and benef|.t greatly from some ex- 
ternal confirmation of the appropriateness of much of what 
they are doing, (p. 15) 

This discussion of the potential fruitfulness of ethnographic research 

Is not, of . course, meant to suggest that other types of research be, abandon- 

ed for ethnographic studies. Nor should studies be directed only St determin 

ing what is good about current practice. However, the Intent is to argue 

that the legitimacy of a greater variety of research methods be> accepted. 

Also, the choice of appropriate research methodologies should mofe frequently 

be based on considerations such as appropriateness for the schooling setting 

and the problem to be addressed, and the state of knowledge in the area of 

interest (see Shaver & Larkins, 1973). These matters raise issues about the' 

meaning of science and Its relevance and demands for building sound knowledge 

'X- 

about schooling (Shaver, ,in press). 

Verified Theory ? Another reason for the inadequacy of social studies 

^ ■ 

education research findings as a basis for the prescription of practice is 
the overly simple model of instruction/learning that has dominated the design 
of studies. Most studies have compared one method of instruction against 
another with the hope of arriving at a general conclusion about efficacy 
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(see^;e.g., Hepburn, 'Shruiri, & Simpson, 1978, for this traditional approach)- 
^ Complex .interactions between ii;3tructional methbd, /teacher characteV/ist-ics^ 
^^student traits, and situational factors have been considered too rarely. ^ This| 
\o^e/sight probably accounts in large part far the inconsistency in findings 

trom. one supposedly similar study to another which certainly limits the pre- 



scriptive power of the findings. Even, however, when a generalfzation does 
se'em to appear from research studies Qomparing methods, caution in prescrib- 

^ • ' ' ■ \ 

ing practice is in order. As Snow (1977) commented: ^ , I 

. . .[T-]he evaluation question is always, "Did the instruction 
wprk well for the students?" That is, for each student, not 
just for the few who stand in the vicinity of the grpup average. 
And aij instruct ioi;ial treatment that is best on the average may v 
still serve 5ome students poorly, (p, 13) 

Peter Martprella (1977) made 'the same point, but even more emphatically: 

All research generalizations, no matter how exrtensive their 
external validity, reflect only statistical probabilities 
about individuals., . . . [wjhile research apparently con- 
tinues to add to our knowledge about individuals in general, 
it tells us -nothing about any given individual. It may 
even distort our perspective on a particular student, (p. 44) 

Such statements have serious implications for the development of general 

instructional theory, verified by research^^^ich can be used as a basis for 

prescribing the experiences to be provided, individual students in social 

studies classes.' 

Snow (1977) has argued^ that ''general instructional theory. . . is a holy 

grail" (p. 15). If instrtictional theory is to be developed at all, in his ' 

view, it must|^local theory — <r.*£;, specific to subject-matter, grojjps of stu- 

dents, and local situations~-as well as ttme-limited (see^ Cronbach, 1975, ^ 

pp. 122-3). This view is in direct contrast to that of many persons who 

advocate the "scientifif" developnvwit of instructional theory — 

[modeling] their work on physical science, aspiring to amass 
etnpirical generalizations, to restructure them into more 

. ■ . 20 
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general, lavs 9 and to veld scattered laws Into coherent 
' t theory. (Cronfii^h, 15|j|5, p. 125) , , , 

The difficulty in applying the physical science theory-building model too 

literally is that 

• « * ** 

rarely is a social or behavioral [or educational] phenomeriDn 
isolated epough t© have [a] stea^jir-process pj;g£^iWy- Hence 
the explanations we live by will perhaps alvays remain partial, 
atid distant frotil real events. . . and rather short lived. . . . 
Our troubles do not arise because human events are in ^principle 
unlawful; man and his creations are part of the natural world. 
The t^oiibl^ is. . . th^t we cannot store up generallaations 
and constructs for ultimate assemble into a network. , (Crortbach, 
1975, p. 123) y 

In broader context, the question must be asked, 'Is schooling-learning 

behavior too complex for traditional, conceptionalizations of scientific ^ 

theory to ever lead to bases for practice? Or, is Victor Weisskopf (1977), 

a physicist, correct in his implied optimism? 

The study of social relations hetween individuals of a given 
species — be it animals or men — is still in its infancy. We 
are groping , to find appropriate methods, concepts, and lan- 
uages that vill enable us to arrive at formulations and <ion- 
,4 elusions that have an objective validity comparable to- the 
' natural sciences., (pp. 409-10) 

Certainly, the meaning of science and the implications for building 

solid, cumulative knowledge about schooling generally, and in social studies 

in particular, have not been adeijuately addressed by educational researchers 

in general and social studies education researchers in pat'tlcula^^ Science 

has made Impressive strides in understanding the natural world and providing^ 

bases for engineering achievements. Whether the scientific modes of the 

physical ^sciences are applicable to instructional research; and, if so, which 

aspects and with what modifications, are questions that ckallenge the entire 

A 

social studies educational research enterprise as it now operates. Yet, un- 
less such questions are addressed, it does not appear likely that a less ^ 
^skeptical view of |the usefulness of educational research findings for jsocial 
studies curricular/instructional decision-making will be Justified in 
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futi^re yjBars. i . . 



onclusion . ^ 



Tliere are a number of reasons why social studies education^^s4arch 
(as well as educational research generally) is not of much use to social 



studies teac^h^'r a and others making curricular/instructiori^l decisions^ in 

The same research f indirfgs' apd/or theory •ptij^.^tiggest alternative, 
N even^conf lie ting, prescriptions for practice depending on pther factual as- 
sump-tions and one's value position; there are f ew^umulative findings about 
^ the effefctiveness of differing curricula and instructional methods; re- 
searchers have tended, not to address questions of ''intere9t to those opera t- 
^Ing in the "real life" of the school; the statistical significance model of 
research with its yes/no dichotomy and its inattention to explained variance 
and to the need to replicate findings has, dominated the research; interact- 
ions among various instructional, personological, and contextual variables 
^ are so complex that prescriptions based* on simple analyses of central tend- 
ency often do not apply to individuals,;^ and general instructional theory that 
cao provide specific prescriptions fox instruction may well be not only cur- 
rently nonexistent but unattainable. 

Nevertheless, the skepticism in this paper. about the current usefulness 
of educational research findings for curricularVinstructional 'decision- 
making should not be interpreted as pessimism about involvement in the social 
studies educational research enterprise. It does» however, indicate belief 

in a pressing need to re-address the nature of that enterprise, if for no 

♦ 

• other reason than to avoid the ongoing waste of human and financial re- 
sources as it presently operates. 

In particular, massive attention 'must be focused on our assumptions, or 
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lack of them, about how cumulative knowledge 'helpful in the guidance of -prac- 
tice can bq ^uilt. . We must ask and-explore questions about the nature of 
science and those attributes of science that are applicable to] educational 
research, about the ro,le of theory in education and the possibiiities of 

developing the type of theory we sb desire, about tthe functionality of our 

■ ' * ' ' " ^ ■ ^ • 

research strategies axid methodologies ' for building cumulative knowledge, 

■ i ■ _ ^ ■ - ' 

alyout whether (Cronbach, 1975) our goals shou]^ really be any more than 
"to assess local events accurately, to improve short-run control^' and "to 
develop explanatory concepts, concepts that* will help people use their, headsi' 
(p. 126). ^ We must become more self-cons^ioua' about our enterprise, more 
searchingV more doubtirfg about our traditional orientations and procedural 
modes. . • 

There should be a suspenff4,oh^of knowledge-building research activities — 
as contrasted with the^ Importaot, but less aspifing local "action-type" re- 
search — until we can get our epistemological house in better order, I know 
that such' a hiatus is not, likely to occur. There are too many vested interests, 
• and the power of the Zeitgeist is too strong — even for me. If, however, even 
a sizeable minority would begin to address systematically the types of ques- 
tions raised by *the powerlessness bf educational research in the face of the 
demands of educational prescription, the self-conscious, rational development 
of scientific orientations and modes appropriate to education might emierge> as 

\ ■ 

the new Zeitgeist — unless, of course, our efforts bring us to the menacing, 
but ironically humanistic, conclusion that human relations, and educational 
practice in particular, areNtoo complex, subtle, knd value laden to be illumin- 
ated adequately through the insights that can come through scientific types of 

I- ' . 

research.-*-^ 



^ See Weisskopf (1977, pp. 410-11)*" fiDr a provocative discussion of the 
limits of science for understanding human experience. 
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